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(57) Abstract 

Method of motion-compensated video processing such as standards conversion, uses motion vectors assigned on a pixel- 
by-pixel basis. Hie pixels of an input video signal are written to locations in a video store (24) determined by the motion vector 
assigned to that pixel. Multiple vectors can address a single written pixel to enable mixing of backward and forward vectors. A 
confidence value governs the accumulation of pixels and the later interpolation between motion compensated fields. . 
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MOTION COMPENSATED V IDEO PROCESSING 

This invention relates to video processing techniques and apparatus in which 
use is made of the measured motion in sequences of video images. In an 
important example, the invention relates to motion compensated standards 
conversion. 

Standards conversion is the process of converting television signals between 
different scanning standards, particularly between European (PAL) and American 
(NTSC) television signals. The present invention, in this aspect, is concerned 
with the temporal interpolation of fields at new instants of time, rather than 
colour encoding and decoding which is also required for standards conversion. 
The description below describes processing of luminance signals; processing of 
the colour signals is performed in parallel in a similar manner. 

Standards conversion is conventionally performed using linear filtering 
techniques. The techniques are, essentially, the application of a linear, vertical- 
temporal fitter to the television signal. The quality of the conversion process, 
using this technique, is critically dependant on the details of the interpolation 
aperture (filter coefficients) which is used. The design of the filter aperture is a 
compromise between removing aliasing in the signal, which produces 
undesirable artifacts such as judder and flicker, and removing detail or blurring 
moving images. Although acceptable results can be achieved with this 
technique, the results are a compromise and picture artifacts, such as judder or 
blurring, can easily be seen on some types of pictures. 
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To avoid the problems inherent in conventional standards conversion the 
technique of motion compensated interpolation has been suggested. This uses 
information of the apparent movement of objects in television scenes to improve 
the conversion process. 

If motion compensation can be achieved it largely eliminates the aliasing 
impairments which are unavoidable in conventionally standards converted 
pictures. Since the aliasing impairments are avoided there is no need to 
compromise the filter coefficients used for interpolation. Therefore, in addition 
to giving a picture which is free from alias impairments, the use of motion 
compensation allows much more of the resolution, present in the original 
pictures, to be retained following standards conversion. 

It is an object of one aspect of this invention to provide high 
quality motion compensated interpolation for standards conversion. The 
invention is concerned in this respect with the manner in which motion vectors 
are used for improved interpolation of images, rather than the measurement of 
apparent motion in television picture. There are many known ways in which 
motion can be measured and suitable motion vectors fields can be derived for 
use with this invention. 

The process of motion compensated standards conversion is, essentially, that 
of interpolation along the motion trajectory. The assumptions behind this type 
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of motion compensated interpolation are that the scene comprises a number of 
linearly translating rigid objects. This simple model is adequate for most areas of 
the picture. It breaks down, however, in regions of revealed or obscured 
background. Care must be taken, in dealing with these areas of the image, as 
they can have a disproportionate effect on the overall quality of the interpolated 
pictures. 

In order to perform motion compensated interpolation, it is necessary to 
displace the image of objects in the input pictures to the appropriate position in 
the output picture. This is achieved with the aid of what may be called a 
'picture shifter'. The picture shifter restructures the input image so that all the 
objects within it are moved to their correct position in the output image. These 
motion compensated input fields, can then be combined to produce an output 
image. By this method an output picture is produced in which there is only one, 
correctly positioned, image for each object. Conventional standards conversion, 
by contrast, generates an output picture with multiple images of each object, 
none of which are in the correct position. 

The picture shifting function, in motion compensated systems, is often 
performed by using a variable delay. In a raster scanned television system the 
introduction of a delay in the signal path produces a spatial shift in the image. 
Small. delays give horizontal shifts while delay, by a multiple of the number of 
pixels in a line, gives a vertical shift. Any spatial displacement can be produced 
by introducing the correct delay. By introducing a variable delay a mechanism is 
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provided for dynamically shifting the position of objects within an image. 

In a known motion compensated standards converter, using for example four 
field stores, the information needed in field interpolation to generate a pixel in 
output field, is read from the four input fields using the motion vector (delay) 
associated with that pixel. This means of course that the motion vectors must 
have first been converted to the new standard. Problems are likely to arise 
with revealed or obscured background and further processing may be required 
to avoid objectionable artifacts. 

It is an object of the present invention to provide an improved method of 
motion compensated video processing - for example standards conversion - 
which is capable of providing high quality output without undue complexity. 

Accordingly, the present invention consists in one aspect in a 
method of motion-compensated video processing utilising motion vectors 
assigned substantially on a pixel-by-pixei basis, wherein pixels of an input video 
signal are written to locations in a video store determined by the motion vector 
assigned to that pixel. 

Advantageously, a confidence level is derived for each motion vector. 
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Preferably, pixels are accumulated with a weighting determined by the 
confidence level of the motion vector controlling the address to which the 
respective pixel is written. 

Suitably, each motion vector is scaled in relation to the confidence level. 

In still a further aspect, the present invention consists in a method of 
motion-compensated video processing in which an interlace to sequential 
conversion is conducted prior to motion compensation. 

In standards conversion, the approach according to this invention has the 
important advantage that no standards conversion of the motion vectors is 
required. Equally important is the fact that for a specific output pixel there is not 
just one motion vector. As will be more fully explained, the constraint in prior 
motion compensated standards conversion that a single motion vector is applied 
to each output pixel has significant disadvantages if background is obscured or 
revealed during the interval over which temporal interpolation is conducted. In 
the known system, the same motion vector is applied to both foreground and 
background. The present invention enables the foreground and background to 
be assigned different motion vectors. If appropriate a blend of foreground and 
background can be conducted. This has the important advantage of removing 
the "cut-out" appearance of moving objects in prior art systems where a choice 
is made between background and foreground about the perimeter of an object 
which often vj& not have a clean edge. 
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If there is a pixel to which no information is written, the present invention 
contemplates marking the pixel with a "hole" flag. The hole can then be filled at 
the appropriate stage by interpolation from surrounding pixels. 

The present invention will now be described by way of example with 
reference to the accompanying drawings in which:- 

Figure 1 is a diagram illustrating how variable delays, representative of 
motion vectors, can be introduced in accordance with the present invention. 

. Figure 2 is a diagram illustrating how sub-pixel displacements can be 
accommodated. 

Figure 3 is a diagram showing temporal interpolation in prior art motion 
compensated standards conversion. 

Figure 4 is a diagram similar to Figure 3, showing temporal interpolation in 
accordance with the present invention. 

Figure 5 is a block diagram of a motion compensated standards converter 
according to the present invention. 

Figure 6 is a diagram illustrating vector processing. 
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Figure 7 is a block diagram of one of the motion compensation units of 
Figure 5. 

Figure 8 is a diagram illustrating vector processing in the motion 
compensation units. 

Figure 9 is a block diagram of the motion compensated store shown in 
Figure 7. 

Figure 10 is a block diagram of one of the standards converter units shown 
in Figure 5. 

Figure 1 1 is a block diagram of the temporal accumulator shown in 
Figure 10. 

It has been explained that the function of a picture shifter can be performed 
by a variable delay. The read pointer is incremented regularly, every clock 
cycle, and the write pointer is varied according to the motion vector. For a 
constant delay the read pointer is the write pointer minus n/2, where n is the 
number of samples. If the motion vector is added to the write pointer the effect 
on the image is to 'project' it forward {in time) along the motion trajectory. 
Similarly, if the motion vector is subtracted from the write pointer the image is 
projected backwards along the motion vector. Sub-pixel shifts can be achieved, 
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using this method, by writing an interpolated value in the input picture into the 
buffer. This process is illustrated in Figure 2. 

The difference between implementing motion compensation in the prior art 
manner and in accordance with the present invention is illustrated in Figures 3 
and 4. In both cases contributions from four consecutive input fields are 
combined to generate each output pixel. Figure 3 illustrates the prior art 
approach. In this case the motion vector, corresponding to the current output 
pixel, is scaled and added to the read pointer for each of four field stores. This 
gives a temporal interpolation along the motion trajectory. Only one motion 
vector can correspond to each output pixel. Therefore the same vector is used 
in displacing each of the four fields. At the boundaries between moving objects 
there are areas of recently obscured or newly revealed background. The 
background and foreground objects will be moving with different velocities. 
Hence a single motion vector, as used when modifying the store's read pointer 
is not adequate for these areas of the pictures. In accordance with the present 
invention, the write, rather than the read, pointer is modified so that objects are 
displaced by vectors corresponding to input pixels. Hence different motion 
vectors will be used for the background and foreground objects as illustrated in 
Figure 4. This greatly improves the interpolation of areas of revealed and 
obscured background and, therefore, the quality of the whole image. 

Figure 5 illustrates an overall block diagram of the motion compensated 
standards converter. The input to the system is video scanned on the input 
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standard, together with forward and backward pointing motion vectors 
corresponding to the pixels in input video signal, in addition to the two (forward 
and backward pointing) motion vector signals there is also an indication of how 
reliable the motion vector is. Furthermore there is a status flag for each vector 
indicating whether it corresponds to a foreground or background object. A 
motion estimator capable of deriving these motion vector signals is described in 
British Patent Specification, Application No. 9111348.0 although other motion 
estimation systems could be used. 

The forward pointing motion vector is used for projecting objects forward in 
time along the motion trajectory, and vice versa for the backward pointing 
motion vector. Hence, in a four field standards converter, the forward vector is 
used for the earliest two fields in the interpolation aperture and the backward 
vector for the later two fields. The distinction between the forward and 
backward motion vectors arises because they are derived from considering 
forward or backward displaced frame difference signals. The displaced frame 
difference is only defined for a specific pixel if the corresponding pixel exists in 
the previous or subsequent frame. The forward and backward displaced frame 
differences are thus different, since backward difference is not defined for 
regions which have been newly revealed, and forward difference is not defined 
for regions about to be obscured. This difference is significant because it is 
directly related to regions of revealed or obscured background. 
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The motion vectors are processed in vector processing units 10,12 before 
. they are used. The operation of these vector processing units is illustrated in 
Figure 6. A measure of the confidence in the vector is derived from the 'vector 
estimation error' from the motion estimator. By passing the vector estimation 
error through a lookup table 14, the output from different types of motion 
estimator can be allowed for. The characteristic in the lookup table is as shown 
approximately in Figure 6 and is adjusted empirically to suit the motion 
estimator. To improve further the robustness of the system to errors in motion 
estimation the motion vectors themselves may be scaled according to the 
confidence had in them. Thus a scaling factor relating to the vector error is 
taken from the lookup table 14 and applied to the motion vector in multiplier 
16. When the motion estimator has a large estimation error there can be little 
confidence in the vector and the magnitude of the vector is reduced. This 
reduces the subjective effect of incorrect motion estimation since it is more 
objectionable to use a large incorrect vector than a small one. 

A lookup table 20 provides a confidence value for use later in the process, 
from the vector estimation error and other confidence parameters such as the 
peak height. Compensating delays 18 ensure that timing is maintained with 
other parts of the apparatus. 

Returning to Figure 5, the standards converter itself consists of three parts, 
an interlace to sequential converter 22, motion estimation units 24 and 
standards conversion units 26. Motion estimation is performed by modifying 
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the write pointer to a video store as described in the introduction. One of the 
advantages of this is that it allows motion compensation to be performed wholly 
on the input video standard. This avoids the need to standard convert the 
motion vectors to the output standards. Standards conversion of motion vectors 
is an awkward process which has been required, in previous implementations of 
motion compensated standards conversion. By avoiding the need for standards 
converting the motion vectors not only is the processing simplified but reliability 
is improved as well.^U 

Interlace to sequential conversion of the input video is performed using a 
vertical-temporal filter. The aperture of the filter is not critical but an aperture 
of three fields by four field lines is suitable for this application. The function of 
interlace to sequential conversion is to improve spatial resolution and avoid 
temporal modulation of spatial aliasing at the output of the motion 
compensation part of the system. The frames that are produced for this purpose 
can be maintained throughout the subsequent standards conversion; 
alternatively a return can be made to interlaced field structure. In this particular 
example there is a return to field structure to reduce hardware requirements in 
the standards conversion. This feature of the invention is believed to be 
separately novel and inventive. 

Motion compensation and standards conversion, in this system are split into 
a number of parallel processes. For the interconversion of European (50Hz) and 
American (60Hz) television standards five parallel paths are required. Different 
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numbers of parallel paths could be used for different applications. Each 
standards conversion unit generates, in turn, one in five of the output fields. 
Each output field is constructed from four consecutive, motion compensated, 
input fields (more or less fields could be used in different applications). Each 
motion compensation unit generates, sequentially, the four motion compensated 
input fields required by one standards conversion unit. 

Throughout the process of motion compensation and standards conversion a 
careful check is kept of the reliability of the motion vectors which are used. This 
reliability is indicated by the 'confidence' signals which flow through the 
system. Motion estimation required for standards conversion is a difficult 
process. Experience has shown that the results of motion estimation are not 
always correct. By keeping a check on the reliability of the motion vectors used 
the deleterious effects of motion estimation errors can be minimised. 

Motion compensation is performed wholly on the input standard, by 
modifying the write pointer to a video store, as indicated in Figure 7. Sub-pixel 
shifts are implemented by spatial filter in sub-pixel interpolator 30 as described 
in the introduction and illustrated in Figure 2. The aperture of the spatial 
interpolation filter is not critical and a size of two pixels by two field lines ( or 
four by three) is considered suitable for this application. 

The integer part of the required displacements are implemented by adding the 
integer part of the motion vector - output from motion vector processing unit 28 
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-to the write address of a motion compensation video store 32. The output of 
the store represents a basic motion compensated field. There may, however, be 
parts of this motion compensated field which are unreliable or erroneous. This 
would arise either in regions of revealed background or because the motion 
vectors used were unreliable. This situation would be indicated by a low 
confidence output from the store. This output is taken to a lookup table 34 and 
provides a scaling factor to multiplier 36. If confidence output of the store is 
low then an appropriate fraction of the output is mixed with the input field. That 
is the system gradually falls back to state in which motion compensation is not 
used. The proportion of the basic motion compensated and input fields in the 
final output are controlled by the lookup table driven by the confidence signal. 
The characteristic of the lookup table is roughly as illustrated in the figure and is 
adjusted empirically to suit the motion estimator. Finally the confidence output, 
for the motion compensated field, from the motion compensation unit is derived 
via another lookup table 38. 

The output from the motion compensated store 32 passes through hole filler 
37 which is activated by the above-described hole flag within the confidence 
measure, to fill a hole through interpolation. 

The vectors and confidence signals used by the sub-pixel interpolator 30 and 
motion compensated store 32 are derived as illustrated in Figure 8. Forward 
vectors and confidence signals are used for the earliest two fields in the 
interpolation aperture while the backward vector and confidence is used for the 
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later two fields. The motion vectors are scaled according to the position of the 
output field relative to the input field. 

For example, for the earliest input field in the interpolation aperture a scaling 
factor of 1 + alpha would be used as illustrated in Figure 4. Scaling factors of 
alpha, 1 -alpha and 2-alpha would be used for the other fields as further 
illustrated in Figure 4. 

The motion compensated store 32 is illustrated in Figure 9. As described 
earlier, the write address for the store is modified by adding the integer part of 
the motion vector to the output of the write counter 40 while the read counter 
42 increments the read address in a regular progression. If the vector field 
converges in a part of the picture, corresponding to a region of obscure 
background, multiple input values will be written to the same output pixel. This 
is allowed for by accumulating the values written to each output pixel rather 
than merely retaining the most recently written. Hence the write side of the 
store actually implements a read-modify-write cycle using an adder 44 as shown 
in Figure 9. The multiple accesses required to implement a read-modify-write 
cycle can be achieved by operating the store at twice the video sample rate. 
Read access to the store can occur in parallel to write access if the store is 
implemented as several physical devices (say four devices). This is possible 
because the read address is offset from the write address by approximately half 
the capacity of the store (see Figure 1). If input values were merely 
accumulated in the video store brightness variations across the picture would 
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result. Instead the input pixels are pre-scaled by the confidence value for the 
motion vector. At the output of the complete motion compensated store is 
divided by the accumulated confidence value (calculated in the 'confidence 
store'). This process ensures that the sum of the contributions to each output 
pixel always remains exactly unity. Hence there are no brightness variations 
across the output field. 

The standards conversion process is illustrated in Figure 10. It is largely 
based on the architecture of a non-motion compensated standards converter 
described in WO 90/03705. The standards converter comprises a FIFO buffer 
100, a vertical interpolator 102, a temporal accumulator 104 and an output 
field buffer 106. This implementation has a modified temporal accumulation 
section to allow the vector confidence signal to be used. A output field buffer 
has been added. This has been done to allow the arithmetic part of the circuit to 
continue operating whilst the unit is outputting previously calculated results. 
This modification has become practical due to the dramatic reduction in the 
price of integrated circuit memory. 

The modified temporal accumulator is illustrated in Figure 11. This accumulates 
the fields of partial results from the vertical filter on a five field cycle. 
Essentially the content of the accumulation process is cross faded with each 
new input so that the sum of contributions remains unity irrespective of the 
weighting of any individual contribution. This allows each contributing field to 
be weighted according to the confidence levels of the motion vectors used to 
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construct it. The temporal aperture coefficient is used to weight the results from 
each field to perform temporal filtering. The operation of this circuit in one form 
can be illustrated by an example. Suppose that the temporal aperture coefficient 
and the vector confidence remain unity for all five fields. The sequence of 
values at point P is 1,1,1,1,1 while that at point Q is 1,2,3,4,5. The sequence 
of values at point R, which determines the proportion of the new input mixed 
into the accumulated result, is 1, 1/2, 1/3, 1/4, 1/5. Hence the sum of the 
weights applied to the input of the temporal accumulator remains unity at all 
times. At the end of the five field cycle the sum of weights used in the 
accumulation process is always unity irrespective of the values taken by the 
confidence signal or the temporal aperture coefficient. 

In a variation, account is taken of the fact that the aperture of a standards 
converter is desirably arranged to take predominantly high frequency information 
from the outermost fields. A preferred motion compensated standards converter 
according to this invention therefore interpolates fields in essentially two steps. 
First, the forward and backward pairs of fields are combined to form a forward 
field and a backward field. This combination takes into account the need to take 
predominantly high frequency information from the outermost field of each pair. 
Then, the forward and rearward fields are combined in a ratio which takes into 
account the temporal phase and the relative aggregate confidence values. The 
arrangement shown in Figure 1 1 accomplishes this in the following manner. 
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The fields to be combined may be regarded as F, to F 4 . In a first step, the 
mixer 120 receives F, as new data. In a second step, the new data of F 2 is 
added to the old data and an aggregate weighting value k 2 is stored. The value 
k 2 and the corresponding value k 3 for the other frame half, are processed in k 
network 122. This additionally derives the normalizing denominator k 2 +k 3 . In a 
third step, the new data F 3 is mixed with the old data with the appropriate 
weighting. Finally, the scaled new data F, is mixed with the old data. The result 
of these steps is to accumulate the value:- 



It should be understood that this invention has been described by way of 
example only and a wide variety of further modifications are possible without 
departing from the scope of the invention. 
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CLAIMS 

1. A method of motion-compensated video processing utilising motion vectors 
assigned substantially on a pixel-by-pixel basis, wherein pixels of an input video 
signal are written to locations in a video store determined by the motion vector 
assigned to that pixel. 

2. A method according to Claim 1 , wherein a confidence level is derived for 
each motion vector. 

3. A method according to Claim 2, wherein pixels are accumulated with a 
weighting determined by the confidence level of the motion vector controlling 
the address to which the respective pixel is written. 

4. A method according to Claim 2, wherein each motion vector is scaled in 
relation to the confidence level. 

5. A method according to any one of the preceding claims, in which an 
interlace to sequential conversion is conducted prior to motion compensation. 

6. A method according to any one of the preceding claims, an output pixel to 
which no data is written is flagged as a hole and is subsequently filled by 
interpolation. 



WO 94/01970 



PCT/GB93/01404 




SUBSTITUTE SHEET 



WO 94/01970 



PCT/GB93/01404 



Fig. 3 



2/9 



cc 
La 
> 



Fig. 4 



INTERPOLATED 
FIELD 




TIME 



o = INPUT FIELD 
LINES 

X= OUTPUT FIELD 
LINES 



INTERPOLATED 
FIELD 




SUBSTITUTE SHEET 



WO 94/01970 



PCI7GB93/01404 




U- *6 *d 



SUBSTITUTE SHEET 



WO 94/01970 



PCT/GB93/01404 



4/9 




o 

O 



A 



O 



r 


INPUT 

LOOK 
UP 
TABLE 


~JLfldi.no 



GO 

J 



/ 


INPUT 

LOOK 
UP 
ABLE 






indino 



ID 












;NSA 


LAY 


MPE 


LU 

Q 


O J 
LJ 





CO" 




gt3i 



82 



SUBSTITUTE SHEET 



WO 94/01970 



PCT/GB93/01404 



5/9 



o 

UJ 

i CJ 





INPUT 

LOOK UP 
TABLE 


indinc 





.S 1 


INPUT " 

LOOK-UP 
TABLE 


indino 



UJ 

o 



o 

H- 
UJ 

> 



O 

cr 

cr 
o 



_ UJ 

g 9 



Q 

cr 

cr 
o 



UJ 

> 
Q 

cr 

< 
CD 



cccr 

2=> 



+ 

I 



x 

I 



I 



I 



LU 



Q 

cr 

3 



o 
o 



ID 
cr^ 

QUI 
I— 

LJ UJ 
UJ LJ 

>§ 



co 

CSi 



z 

UJ 

Q 
u. 

o 



Q 
UJ 

2 <uj 

h- UJ |— 

O 



O 
UJ 
Q 

> 



v— o 

<UJ 

a: uj 



o 
m 

J. 













>- 




< 


00 






UJ 


PE 


O 






0 - 




LJ 





cr 
o 

uj <C 

cog 
00 5- 



:uj 



SUBSTITUTE SHEET 



WO 94/01970 PCT/GB93/01404 

6/9 



LUH-CL 

— >o 



lu>o 



LULU -ri 



< 
q: 

CQ 
ZD 
CO 



Lu 

<ruj 

COLJ 



X 



CL 



uoxaidninw uz 



Q 

Ig 

OLU 



r~7 



Q 
CC 

Set 

<£ UJ 
CD > 



59 

CLU. 
1—2: 
SO 

ou 



doxaidinnw 1 



<9 

po 



UJ 
OU 

<LU 

<o 



SUBSTITUTE SHEET 



WO 94/01970 



PCT/GB93/01404 



Fig. 9 



7/9 



CONFIDENCE 
INPUT 



VIDEO 
INPUT 



ADDER 



CONFIDENCE 
STORE 



WRITE 
SIDE 

OUT 



IN 



READ 
SIDE 



OUT 



ADDRESS ! ADDRESS 



CONFIDENCE 
OUTPUT 



X 




+ 


MULTIPLIER 




ADDER 



49 



INTEGER MOTION 
VECTOR 



VIDEO 
STORE 



WRITE 
SIDE 

OUT 



IN 



READ 
SIDE 

OUT 



AODRESS' ADDRESS 



+ 
ADDER 



WRITE 
COUNTER 



-40 



DIVIDE 
Y BY X 



MOTION 
COMPENSATED 
OUTPUT 
FIELDS 



READ 
COUNTER 



—4? 



SUBSTITUTE SHEET 



PCT/GB93/01404 



8/9 



•5* 




tt 



^ CM 
O £ 

tn 

to lh 
Cm cm 
LTi Co 

& U - 

o o 

in lo 



CM CM 

O S 

in so 

**** 

LO LO 

CSJ CM 

LT\ SO 



t! 



CM CM 

o 3 

LO xo 



Cm ~ 



tt 



CM CM 

O O 

LTI vO 

LO LO 

CM CM 

vO vO 



SUBSTITUTE SHEET 



WO 94/01970 



PCT/GB93/01404 



9/9 




SUBSTITUTE SHEET 



INTERNATIONAL SEARCH REPORT 



Internal -il Application No 

PCT/GB 93/01404 



A. CLASSIFICATION OF SU WliCT MATTER 

IPC 5 H04N7/01 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by dan ft can on symbols) 

IPC 5 H04N 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the tniemauonal search (name of data base and, where practical, search terms used) 



C. DOCUMKNTS CONSIDKRIU) TO BK REI.KVANT 



Category " Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



EP.A.O 294 958 (SONY CORPORATION) 14 
December 1988 

see page 11, line 18 - page 13, line 48; 
figures 11-16 

EP.A.O 341 769 ( LAB0RAT0IRES 
D'ELECTRONiqUE ET DE PHYSIQUE APPLIQUEE 
L.E.P.) 15 November 1989 
see the whole document 



EP,A,0 478 217 (SONY BROADCAST & 
COMMUNICATIONS LIMITED) 1 April 1992 
see column 3, line 29 - column 4, line 6; 
figure 1 



1 
5 



-I— 



m 



Further documents arc listed in the continuation of box C, 



m 



Patent family members are listed in annex. 



* Special categories of a led documents : 

"A* document defining the general state of the art which is not 

considered to be of particular relevance 
"E" earlier document but published on or after the international 

filing date 

*L" document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

'O* document referring to an oral disclosure, use, exhibition or 
other means 

*P* document published pn or to the international filing date but 
later than the priority date claimed 



T* later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

'X* document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y* document of particular relevance; the claimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
* ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of the actual completion of the international search 



10 December 1993 



Date of mailing of the international search report 



1 7. 12. 93 



Name and mailing address of the ISA 

European Patent Office, I\B. 5B1 8 Patentlaan 2 
NL- 2280 I IV Rijswijk 
Td. ( * 31-70) 340.2040. Tx. 3 1 65 1 cpo nl, 
Fax( : 31-70) 340-3016 



Authorized officer 



Verleye, J 



Form PCT7ISA/21Q (second ihtei) (July 1992) 





INTERNATIONAL SEARCH REPORT 


Internal J Application No 

PCT/GB 93/01404 


C(Connmi4tion) DOCUMENTS CONSIDERED TO BE RELEVANT 




Category " 


Citation of document, with indication, where appropriate, of the relevant passages 




P.X 
P,Y 


EP.A.O 514 012 (VISTEK ELECTRONICS 
LIMITED) 19 November 1992 
see page 5, line 42 - page 7, line 19; 
figures 5,6,12A,12B 


1 

2,5 



Form PCT/1SA. 210 (co&usiution of cecona ihtzi) (July 1993) 



INTERNATIONAL SEARCH REPORT 

informaii an on patent family r 



Internal* Application No 

PCT/GB 93/01404 



n iu.cn i uocurncm 
cited in search report 


rllDIBG&IIOn 

date 


Patent family 
member(s) 


Publication 
date 


EP-A-0294958 


14-12-88 


fcr « 


A90AQK0 


.IT 1C wo 






GB-A.B 


2205707 


14-12-88 

AT 1l DO 






GB-A.B 


2205713 


14-12-88 






1D-A- 
Jr A 




22-12-88 






JP-A- 


64000877 


U9 1/1 






US-A- 


4862266 


29-08-89 






US-A- 


4862267 


29-08-89 


EP-A-0341769 


15-11-89 


FR-A- 


2630842 


03-11-89 






JP-T- 


2504216 


29-11-90 






WO-A- 


8910600 


02-11-89 






US-A- 


5060064 


22-10-91 


EP-A-0478217 


01-04-92 


GB-A- 


2248361 


01-04-92 






US-A- 


5162907 


10-11-92 


EP-A-0514012 


19-11-92 


NONE 







Foirn PCT/1SA.'3I0 (paUni family umkx) (July 1993) 



00 102 529.5 



1 

Claims 

1 . A method for inspecting photomasks comprising the steps of: 
providing a design data set for fabricating a photomask; 

5 searching the design data set for sub-groundrule features; 

eliminating the sub-groundrule features from the data set to form an 
inspection data set; and 

inspecting a photomask fabricated in accordance with the design data set 
by employing the inspection data set. 

10 

2. The method as recited in claim 1 f wherein the sub-groundrule features 
include sub-groundrule spaces and the step of eliminating the sub-groundrule 
features further comprises the step of merging features of the design data set 
which are adjacent to the spaces such that the space are eliminated in the 

15 inspection data set. 

3. The method as recited in claim 2, wherein the step of merging features 
includes merging features by employing a biasing process. 

20 4. The method as recited in claim 1 , wherein the photomask includes sub- 
groundrule lines and the step of eliminating the sub-groundrule features further 
comprises the step of removing the sub-groundrule lines from the design data set 
to provide the inspection data set. 

25 5. The method as recited in claim 1 , wherein the step of searching the design 
data set for sub-groundrule features includes the step of searching the design data 
set for sub-groundrule features according to predetermined feature size criteria. 

6. The method as recited in claim 1 , wherein the step of inspecting the 
30 photomask fabricated in accordance with the design data set by employing the 
inspection data set includes the step of adjusting a sensitivity of an inspection tool 
to overlook the sub-groundrule features. 
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7. The method as recited in claim 1 , wherein the step of providing a design 
data set for fabricating a photomask includes providing a computer rendered 
digital pattern for fabricating the photomask. 

5 8. A method for inspecting photomasks comprising the steps of: 

providing a design data set for fabricating a photomask; 

identifying sub-groundrule features in the design data set which meet 
predetermined size criteria; 

forming an inspection data set by eliminating the identified sub-groundrule 
1 0 features from the design data set; 

providing an inspection tool for comparing a photomask fabricated in 
accordance with the design data set to the data of the inspection data set; 

adjusting the inspection tool such that identified sub-groundrule features are 
overlooked; and 

1 5 inspecting the fabricated photomask by employing the inspection data set. 

9. The method as recited in claim 8, wherein the sub-groundrule features 
include sub-groundrule spaces and the step of forming an inspection data set 

20 further comprises the step of merging features of the design data set which are 
adjacent to the spaces such that the spaces are eliminated in the inspection data 
set. 

10. The method as recited in claim 9, wherein the step of merging features 
25 includes merging features by employing a biasing process. 

1 1 . The method as recited in claim 8, wherein the sub-groundrule features 
include sub-groundrule lines and the step of forming an inspection data set further 
comprises the step of removing the sub-groundrule lines from the design data set 

30 to provide the inspection data set. 

12. The method as recited in claim 8, wherein the step of searching the design 
data set for sub-groundrule features includes the step of searching the design data 
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set for sub-groundrule features according to predetermined feature size criteria. 

13. The method as recited in claim 8, wherein the step of providing a design 
data set for fabricating a photomask includes providing a computer rendered 
digital pattern for fabricating the photomask. 

14. A program storage device readable by machine, tangibly embodying a 
program of instructions executable by the machine to perform method steps for 
inspecting photomasks, the method steps comprising: 

providing a design data set for fabricating a photomask; 

searching the design data set for sub-groundrule features; 

eliminating the sub-groundrule features from the data set to form an 
inspection data set; and 

inspecting a photomask fabricated in accordance with the design data set 
by employing the inspection data set. 

15. The program storage device as recited in claim 14, wherein the sub- 
groundrule features include sub-groundrule spaces and the step of eliminating the 
sub-groundrule features further comprises the step of merging features of the 
design data set which are adjacent to the spaces such that the space are 
eliminated in the inspection data set. 

16. The program storage device as recited in claim 15, wherein the step of 
merging features includes merging features by employing a biasing process. 

17. The program storage device as recited in claim 14, wherein the photomask 
includes sub-groundrule lines and the step of eliminating the sub-groundrule 
features further comprises the step of removing the sub-groundrule lines from the 
design data set to provide the inspection data set. 

18. The program storage device as recited in claim 14, wherein the step of 
searching the design data set for sub-groundrule features includes the step of 
searching the design data set for sub-groundrule features according to 
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predetermined feature size criteria. 

19. The program storage device as recited in claim 14, wherein the step of 
inspecting the photomask fabricated in accordance with the design data set by 
5 employing the inspection data set includes the step of adjusting a sensitivity of an 
inspection tool to overlook the sub-groundrule features. 
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20. The method as recited in claim 14, wherein the step of providing a design 
data set for fabricating a photomask includes providing a computer rendered 
digital pattern for fabricating the photomask. 



